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A Technique for the Measurement of 
Attitudes 


I. INTRODUCTION* 


Attempts to measure the traits of character and personality 
are nearly as old as techniques for the measurement of intel- 
lectual capacity, yet it can scarcely be claimed that they have 
achieved a similar success. Part, at least, of the difficulty 
has lain in the statistical difficulties which are encountered 
when everyday aspects of social behavior, ordinarily handled 
as qualitative affairs, are treated from the mathematical point 
of view. The present study, although part of a larger in- 
vestigation undertaken in 1929 by Gardner Murphy, aims 
primarily at the solution of a technical problem which has 
arisen in relation to the quantitative aspects of the study of 
social attitudes. 

The history and present status of research upon personality 
traits in general, and social attitudes in particular, have been : 
so thoroughly surveyed by Murphy (21, pp. 381-386, and 22, 
pp. 558-690), Bain (4), Vetter (41), Katz and Allport (16), 
Watson (43), and others, that no useful purpose would be 
served in attempting such a study here. ; 

Nevertheless, among the hundreds of efforts to measure 
social attitudes during the last few years, the careful pro- 
cedures developed by Thurstone (34, 38) have naturally and 
rightly received special attention. These are characterized 
by a special endeavor to equalize the step-intervals from one 
attitude to the next in the attitude scale, using the familiar 
methods of psychophysics for such determinations. The Thurs- 
tone methods have been shown to yield a satisfactory relia- 
bility, and, in terms of correlations between scores and case 
histories as evaluated by judges, a satisfactory validity (29). 

Many obvious affinities appear between the present study 
and those of Thurstone, yet in a sense the present report 





* This study is one of a series under the general direction of Professor 
Gardner Murphy. 
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constitutes a radical departure from the concepts which Thurs- 
tone has published, as, for example, in the use of judges. 

A number of statistical assumptions are made in the ap- 
plication of his attitude scales,—e.g., that the scale values 
of the statements are independent of the attitude distribution 
of the readers who sort the statements (38, p. 92),—assump- 
tions which, as Thurstone points out, have not been verified. 
The method is, moreover, exceedingly laborious. It seems 
legitimate to inquire whether it actually does its work better 
than the simpler scales which may be employed, and in the 
same breath to ask also whether it is not possible to construct 
equally reliable scales without making unnecessary statistical 
assumptions. Since so much is being published about attitude 
measurement, it seems worth while to raise these questions 
and to report on some results relative to the problem. It is 
feared that some will mistakenly interpret this article as an 
“attack” on Thurstone’s methods. I therefore wish to em- 
phasize in the strongest terms that I am simply endeavoring 
to call attention to certain problems of method, and that I 


am very far from convinced that the present data close the 
question. 
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II. PROBLEM 


From an historical point of view one fact deserves emphasis, 
namely the extraordinary interest in recent years in the prob- 
lem of the “generality” or “specificity” of character traits—a 
problem which in its simplest form has to do with the question 
of the functional independence of social habits. Roughly 
speaking, the specificity theory would define personality as 
a composite of many independent habits, while those who em- 
phasize the relative unity of character point to significant 
general factors which make for effective prediction from be- 
havior in one situation to behavior in a different situation. 


- It seems to the present writer that the problem of specificity 


has been greatly misunderstood by many writers upon social 
attitudes and that the value of such contributions as the pres- 
ent may lie chiefly in redirecting attention to those aspects 
of the specificity-generality problem upon which quantitative 
results are clear-cut and psychologically significant. It will 
be well first to consider briefly the logic of the specificity-gen- 
erality problem, then to present and evaluate our data, and 
finally to undertake to find the psychological significance of 
our data in relation to the problem raised. 

If an attitude be defined by the social psychologist as a 
tendency toward a particular response in a particular situa- 
tion, it is clear that the number of definable attitudes existing 
in a given person at a given time will depend upon the range 
of stimuli to which he is subjected. But since it is possible © 
to group stimuli in almost any conceivable manner and to 
classify and subclassify them indefinitely, it is strictly true 
that the number of attitudes which any given person possesses 
is almost infinite. This result is statistically as well as psycho- 
logically absurd. Exactly the same absurdity and the same 
obstacle to research is offered by those definitions of attitude 
which conceive them merely as verbal expressions or as in- 
dications of assent to or dissent from particular verbal expres- 
sions. The number of possible verbal combinations is, of 
course, infinite and the number of attitudes must on this basis 
likewise be so. It is clear then that those who have defined 
attitudes in the above two ways have not meant exactly what 
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8 A TECHNIQUE FOR THE 


they have said. They have really intended to indicate not the 
actually discriminable tendencies to overt action or the verbal- 
response patterns but certain discernible groups of social 
responses. Within each group a family resemblance of the 
various responses is assumed, and each group of attitudes is 
supposed to show some distinguishable difference from every 
other group. If the analysis is pressed far enough, this turns 

out to mean that the attitude is a habit sufficiently compact | 
and stable to be treated as a unit. It will, of course, be recog- 
nized that variations of an individual’s response within this 
sphere of a given “attitude,” together with differences between 
each attitude and the next, are involved. If it is my “attitude” | 
to regard the eating of starches as a dietetic monstrosity, 
either an inherited dislike for such foods or a bundle of ac- 
quired tendencies directed towards bread, potatoes, rice, etc., 
must be assumed to exist. Whether we take the attitude _ 
therefore as an entity innate or learned, it is in either case not 1 
an inflexible and rigid element in personality (if, in fact, any 
such elements exist), but rather a certain range within which 

esponses move. 

On this basis one of our cardinal problems is to find whether 
social attitudes, in this sense, can be shown to be measurable, 
and if an affirmative answer is forthcoming, a serious attempt | 
must be made to justify the separation of one attitude from | 
others. For if there are no family differences between atti- | 
tudes, there is simply one infinite series of attitudes. On this | 
basis the measurement of attitudes could never mean any- | 
thing more than the determination of an amount of some one | 
tendency present, but what this one tendency actually is could © 
never be defined. 

Perhaps vaguely realizing this difficulty, many investigators | 
in the field of attitude measurement have assumed a sharp | 
distinction between different families of attitudes, and per- 
fect resemblance or indeed identity between the members of © 
any given family of responses. Take, for example, the fre- | 
quent raising of questions as to whether there is a relation | 
between internationalism and economic liberalism. Such termi- | 
nology is based upon two assumptions: first, that there is an 
entity to be called internationalism, the boundaries of which 
can be so defined as to separate it from economic liberalism 
and permit one to tell which is which—otherwise the state- 
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ment is tautological—, second, it is assumed that within the 
sphere of internationalistic responses there is good prediction 
from one response to the next. Internationalism is treated 
as an entity such that the defining of a person’s international- 
ism on a given issue would define his internationalism on all 
others. 

We have not been concerned up to the present, to define the 
term “attitude,” since the logic of the above argument seems 
to be the same when applied to either of two prevailing defi- 
nitions of attitude. Contemporary definitions cluster about 
two chief conceptions: first, that_attitudes are dispositions 
toward overt action; second, that they are verbal substitutes 
for overt action. The former usage seems to the present 
writer to be preferable.* The verbal declarations of opinion 
and attitude are regarded as an indirect method of measuring 
dispositions which are most easily signified and expressed in 
verbal form. It is desirable, however, to point out that the 
same considerations regarding specificity and generality apply 
to the verbal declarations as to other social habits. The same 
problem of group factors and special factors appears even 
when dealing with paper and pencil behavior. 





Consequently whether attitudes be defined in terms of un- 


derlying dispositions toward overt action or in terms of mere 
verbal declarations, investigators have proceeded almost with- 
out question upon the assumption that social attitudes are 
grouped in patterns or clusters. A series of verbal proposi- 
tions dealing with the same general social issue are assumed 
to be more or less equivalent, or at least to be closely related 
so as to permit prediction from a knowledge of a subject’s 
attitude on one issue to the same subject’s attitudes on other 


aspects of the same issue. Similarly, overt behavior favorable J 


to or in opposition to a racial, national, religious, or economic 
group, is assumed to have some predictive value in relation to 
conduct in the future when the same group or class is again 
involved. Speaking generally, attitudes may be conceived a 
“clustered” or linked together; a general pro-Japanese mre 
tude, for example, may show itself in a series of pro-Japanese 


* If an exact definition be regarded as useful, the following (Century 
Dictionary and Cyclopedia, 1904-1906, I, 374) is preferred: “relation of 
persons viewed as the expression of, or as affecting, feeling, opinion, in- 
tentions, ete.” 
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verbal declarations or a series of pro-Japanese overt acts. In 
statistical language, a group factor is assumed at the outset. 
Now just as the student of mental organization recognizes 
group factors which vary greatly in their magnitude and 
significance, so the student of attitudes tends to think of rela- 
tively important group factors occurring in some attitude 
areas and relatively unimportant ones in others. Here, how- 
ever, the agreement among the investigators ends. In the 
few short years during which any serious statistical sophis- 
tication has existed in attitude research, much acrimony has 
been evident between those who are concerned to regard the 
group factors as slight and unimportant, and those who regard 
them as large and significant. Thus we find Bain (4) insist- 
ing that attitudes cluster together only when they constitute 
alternative verbalizations of the same conative tendency in 
relation to a specifically defined social situation. The various 
studies in the specificity of character traits have led to a wide- 
spread and, it must be admitted, highly uncritical acceptance 
of the view that verbal propositions have no predictive value 
for anything else in life except similar verbal propositions 
confronted by the same subject under the sams *ircumstances. 
On the other hand, an excessively general view of character 
traits is naively assumed with almost equal frequency by 
writers who have discussed radicalism and conservatism, some 
of whom have defined the characteristics of radicals and con- | 
servatives, suggesting evidence as to the psychological mech- | 
anisms making for such general trends. Thus as early as | 
1924, H. T. Moore (20) defined five basic psychological char- | 
acteristics predisposing towards radicalism as contrasted with | 
conservatism, and as recently as 1929 and 1930 G. W. All-. 
port (2, 3) has argued for a cluster of traits, chiefly intellec- 
tual, which make for radicalism on political, economic, and 
other social issues. 

It seems to be high time to cut through the statistical con- 
fusion which has resulted from the whole specificity-generality | 
argument, to bring out the actual points of disagreement | 
which separate these rival groups of psychologists, to make | 
clear the statistical assumptions involved in all such methods | 
of reasoning, and above all to test empirically in an extensive 
way the actual coherence or clustering of attitudes on a variety 
of public issues. 
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Ill. PROCEDURE 


The project conceived in 1929 by Gardner Murphy and the 
present writer aimed first of all to present a wide array of 
problems having to do with these five major “attitude areas”: 
international relations, race relations, economic conflict, po- 
litical conflict and religion. The attitude areas best covered in 
the questionnaire are those of race relations, international re- 
lations, and economic conflict. It was our conviction that very 
high specificity would exist among the elements used in our 
questionnaire, except insofar as the questions clearly dealt 
with the same issues. On the basis of results obtained by 
C. W. Hunter (15), for example, in the field of Negro-white 
relations, it was believed that attitudes toward segregation, 
toward eating with the Negro and toward lynching would be 
independent, and that in general any one specific attitude to- 
ward the Negro would bear no clear relation to the attitudes 
on other issues. This, of course, does not mean that we ex- 
pected to obtain the rather ideal specificity which would be 
indicated by a zero reliability (by the split-half method) when 
comparing pro-Negro attitudes on some items with pro-Negro 
attitudes on others. It does mean, however, that we expected 
fifteen attitudes dealing with nearly fifteen different issues in 
which the Negro is involved, to give exceedingly low split- 
half reliability, and that in order to obtain anything like a 
true “scale” for the measurement of such a thing as pro- or 
anti-Negro feeling, one would have to employ dozens or even 
scores of questions. In the same way, the specificity of opin- 
ions on international and economic issues was assumed to be 
so great that an enormous number of items would have to be 
used in order to give a satisfactory reliability for any scale 
which could be constructed. It is important to emphasize 
these expectations at the outset, since the results, although in 
some respects confirming our belief, have in general yielded 
remarkably clear-cut group factors, group factors which in 
the light of the small number of items used must be regarded 
as having, for the student subjects used, a status as clear as 
that enjoyed by group factors of immediate memory, verbal 
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ability, and the like to which a number of statisticians have 
called attention. 

The method by which the questionnaire was constructed was 
as follows. Having determined to study intensively the mat- 
ter of international, inter-racial and economic attitudes, and, 
to a minor degree, political and religious attitudes, among 
i large numbers of college students at typical American uni- 
versities, a survey was made of the questionnaires already ad- 

3 ministered by other psychologists for these purposes. Among 
Hl those which proved especially helpful were those of G. B. Neu- 
: mann (23), C. W. Hunter (15) and R. W. George (9). In 
i addition, about two hundred newspapers and magazines were 
: rapidly surveyed during the autumn of 1929, declarations of 
\opinion being culled for consideration, special emphasis being 
given to the more dogmatic types of opinion frequently 
found in editorials. A small number of questions were in- ~ 
cluded from books, addresses and pamphlets, and a number 
| were made up by the experimenters. Wherever it was possible 
to use questionnaire material which had previously been ex- | 
\ tensively tried out, and where, in a sense, “norms” were avail- ~ { 
able, we preferred to use the questions exactly as they stood. | 
\ In a few cases, it was necessary to abbreviate and simplify 
the questions in order to make sure that only one issue was 

\ involved and that ambiguity was avoided. In those instances © 

‘in which we made up our own questions, we sought to empha- 
size simplicity, clarity, and brevity. 
Without exception, the questions were presented in such a ) 

. form as to permit a “judgment of value” rather than a “judg- 

ment of fact.” Phrases such as “The United States should,” | 
or “We ought to,” or “No man should be allowed” constantly | 
reappeared. In a few instances it may seem on first inspec- 
tion that a question has to do with a question of fact, but 
closer analysis will reveal the highly arbitrary character of 
such “facts.” Perhaps the least desirable of all the questions 
used was the following: “Is war at present a biological neces- 
sity?” Such a question appears to many minds to be categori- 
cally a factual one; for example, from a neo-Malthusian point 
of view it may be regarded as capable only of an affirmative 
answer. The term “necessity,” however, refers here more to 
the student’s attitudes toward various wants than to any of 
those types of necessity which are discussed by physicists or 
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have logicians. This is not offered in defense of the use of this 
particular item, which is regarded as one which should have 
J was been omitted; this explanation is offered only to make clear 
mat- that at least in the great majority of cases and, we hope, in 
, and, all, the inquiry has to do with the wants, desires, conative 
mong dispositions of the subjects, not with their opinions regarding 
1 uni- matters of fact. 
ly ad- One further generalization may be offered regarding the 
mong plan underlying the choices of questions. Since value judg- 
. Neu- ments are required, it was conceived that every issue might 
i ia be presented in such a way as to allow the subject to take sides 
. were as between two clearly opposed alternatives. Furthermore. 
yns of each issue was so drawn that two conflicting groups of per- 
being sons were either named or implied, and the subject allowed 
uently to affiliate himself with one or with the other group. In the 
re in- struggle of the Negro, for example, to attain economic, politi- 
umber cal, or social equality, where the white man resists such 
yssible equality, the subject has an opportunity either to take or to 
en eX- refuse to take the Negro standpoint. In the case of the con- 
avail- - flict of relatively unfavored economic groups against those 
stood. who enjoy special opportunities, and in the case of weaker 
mplify nations which demand greater territorial or economic ex- 
ie was pansion than is at present permitted them, the same oppor- 
tances — tunity to ally oneself with one or the other of two opposing 
ampha- factions is involved. Again, it is not asserted that we have 
in all cases succeeded in framing an ideal ‘‘conflict issue.” We 
such a would urge, however, that the great majority of conflict issues 
“judg- covered in our survey are empirically important issues, in 
10uld,” which students at American universities actually do have 
stantly opportunity to take sides and with regard to which the great 
inspec- majority have heard repeated discussions; secondly, that the 
ct, but results constitute in themselves an empirical check on the 
eter of degree of success with which a tendency to take the side of a 
estions given group does enter into our questions in such a way as to 
-neces- be empirically measured. High specificity would have meant, 
itegori- among other things, that we had certainly failed in finding any 
n point general pro-Negro, anti-Japanese, etc. attitudes, and would 
‘mative have led to statistical difficulties of various sorts in handling 
nore to incoherent masses of unrelated material. The clear-cut gen- 
any of erality of certain attitudes, such as pro-Negro, international- 
zists or 


ism, etc., shows that it is precisely in the field of bits 
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Kwwith or against certain social groups that the most definite 
results are obtained. 

Through collaboration with instructors, the attitudes tests 
were given to undergraduates (chiefly male) in nine universi- 
ties and colleges extending from Illinois to Connecticut and 
from Ohio and Pennsylvania to Virginia. (The names of the 
institutions cannot appropriately be printed here, only the 
Columbia College data, Group D, being identified.) The total 
number of individuals participating was somewhat above 
2000 but the data here intensively analyzed were derived from 
only 650* persons. The attitudes test, called a SURVEY OF 
OPINIONS, was first given in the late fall of 1929 (to all 
groups except Group C and Group F which were given the test 

‘ in 1931) and, by arrangement with instructors, a retest given 
30 days later. Some items from the first test and many new 
: items were included in this second test. The first test required 
i on the average about 40 minutes and the retest a slightly 
i longer time. 
The kind of questionnaire material to be reported here falls 
' into four main classes. In the first, questions were to be an- 
swered by a Yes, a question mark, or a No, as for example, 
“Do you favor the early entrance of the United States into the 
League of Nations?” YES ? NO. Next came a series of 
multiple-choice questions in which one of five possible answers 
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e3 was to be selected, for example: “Using the term ‘armaments’ 
an to mean equipment devised for war rather than for police 
= purposes, our policy should be to favor: (a) absolute and im- 
a mediate disarmament of all nations, (b) rapid and drastic 
bar reduction of the armaments of all nations, (c) slow but steady 
: reduction of all armaments, (d) maintenance for a long time 
ee of approximately the present military and naval strength of 
ca all the powers, (e) our free military and naval expansion un- 
ey embarrassed by agreements with other nations.” Third, there 


was a series of propositions to be responded to by the words 
(a) strongly approve, (b) approve, (c) undecided, (d) dis- 
approve, (e) strongly disapprove, for example: “All men 
who have the opportunity should enlist in the Citizens Military 
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* These 650 cases represent a random sample from seven of the groups 

comprised in the study. The data on two of the nine colleges have not as 
yet been analyzed. Of course, only those individuals were used for whom 
we have complete data. 
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Training Camps.” Fourth, a series of abbreviated newspaper 
narratives about social conflicts, terminating in a sentence 
describing the outcome of this conflict, the student being asked 
to indicate his response to this outcome, for example: “A 
group of Japanese truck-farmers in Southern California, 
through their industry and lower standards of living, are able 
to undersell their American competitors. The American farm- 
ers insist that IT IS THE DUTY OF ALL WHITE PEOPLE 
TO PURCHASE ONLY FROM WHITE FARMERS.” This 
last form of question makes use of the same set of five re- 
sponses mentioned above, strongly approve, approve, unde- 
cided, disapprove, and strongly disapprove. 


THE ATTITUDE SCALES 


The different scales presented here have been given their 
respective names merely for convenience in referring to them. 
The names given them seem the most plausible, but to avoid 
any “jingle fallacy” it should be recognized that the scales 
measure merely what the different statements included in 
them involve. 

In the SURVEY OF OPINIONS the statements did not 
appear consecutively as shown in the following scales but were, 
scattered among many statements having to do with other 
attitudes. 


INTERNATIONALISM SCALE 


The numbers in parentheses below or at the side of the different alter- 
natives show the numerical value assigned to them in the final scoring. 
These numbers were, of course, not present upon the SURVEY OF 
OPINIONS when taken by the subject. 


1. Do you favor the early entrance of the United States into the League 
of Nations? 

¥ ? NO 

(4) (3) (2) 


2. Ought the United States to consult other nations in making her im- 
migration laws? 


YES z NO 
(4) (3) (2) 
3. Should the United States give naval demonstrations in the Pacific? 
YES ? NO 
(2) (3) (4) 
4. Is war at present a biological necessity? 
YES NO 


7 
(2) (3) (4) 
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5. Should the United States recognize the Soviet government? 
YES ? NO 
(4) (3) (2) 

6. Should the Treaty of Versailles be reconsidered, with greater leni- 
ency given to Germany? 

YES a3 NO 
(4) (3) (2) 


7. Should the United States cancel a large part of the Allied war debt 
in return for concessions as to disarmament and economic recon- 
struction abroad? 


YES ? ; NO 
i (4) (3) (2) 
8. Should there be a national referendum on every war? 
YES ? NO 
| (4) (3) (2) 
| 9. Do you look with suspicion upon the idea of a Super-State as the 
i future hope of international government? 
4 YES ? NO 
{ (2) (3) (4) 
10. Is it an idle dream to expect to abolish war? 
i YES 2 NO 
(2) (3) (4) 
+ 
} 11. Are you in sympathy with the movement for the outlawing of war? 
i YES ? NO 
i (4) (3) , 3%) 
é 
12, Should the United States enter the World Court? 
YES 2 NO 
(4) (3) (2) 
13. How much military training should we have? 
i (a) We need universal compulsory military training. (1) 
' (b) We need Citizens Military Training Camps and Reserve 
Officers Training Corps, but not universal military train- 
ing. (2) 
i (c) We need some facilities for training reserve officers but 
not as much as at present. (3) 
(d) We need only such military training as is required to 
maintain our regular army. (4) 
(e) All military training should be abolished. (5) 


14. How large should our navy be? 


(a) We should maintain the “two-power standard” formerly 
maintained by Great Britain (i. ours should be as 


strong as any two others). (1) 
(b) We should maintain a considerable margin over our 
nearest competitor. (2) 
(c) We should share first place with another power as at 
present. (3) 
(d) We should attempt only to maintain second place. (4) 


(e) We should not be especially concerned with our rank as a 
naval power. (5) 
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; term “armaments” to mean equipment devised for war 
ve ee hat for police purposes, our policy should be to favor: 


te and immediate disarmament of all nations. (5) 
( en oad drastic reduction of the armaments of all na- 
tions. ‘ (4) 
(c) slow but steady reduction of all armaments. (3) 
(d) maintenance for a long time of approximately the pres- 
ent military and naval strength of all the powers. (2) 
(e) our free military and naval expansion unembarrassed by 
agreements with other nations. (1) 


16. All men who have the opportunity should enlist in the Citizens 
‘Military Training Camps. 


1 Strongly 
yaks Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 


17. The United States, whether a member or not, should co-operate fully 
* “in the humanitarian and economic programs of the League of 


Nations. 

Strongly : . Strongly 

Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


18. In the interest of permanent peace, we should be willing to arbitrate 
absolutely all differences with other nations which we cannot read- 
ily settle by diplomacy. 


Strongly - , ; Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


19. A person who loves his fellow men should refuse to engage in any 
war, no matter how serious the consequences to his country. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


20. The United States should have the largest military and naval air 
fleets in the world. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (5) 


21. We should be willing to fight for our country whether it is in the 
right or in the wrong. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 


22. We must strive for loyalty to our country before we can afford to 
consider world brotherhood. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 
23. Our country should never declare war again under any circumstances. 
Strongly Strongly 


Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


ee? 








FS. % 
323%; 


EGER? Y 


Pr Seto Rees be bx dela ba tetas cies t tet tre Tere 
SEseecL ULE THETALEE TERE Eas Peatst ities 


ea 


! 


nth 


:5 


Bes a. 

erFett) 

ha R33 
tae? 


K 


StPrens be ep 


e* 3 2g7 


ee 
eTUSCHTETTE Thi 


4 


Seistrtaiere 


2+. 






f tipitier 


$ 
a 


EU Prteeysnptrerteys 


<4 


re 
CENA pea we 


ae 


aia. fF 





ies 


Se 


bee 


EBHE 


Xstreet en ge 9 


ache eerie eesti ape tne gS op eet 


BA 


pede ellie he 


waar anh hiatal + el cetis 


i aint pal a eg 





18 





A TECHNIQUE FOR THE 


24. Moving pictures showing military drill and naval manoeuvres should 


be exhibited to encourage patriotism. 


Strongly ; Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 


NEGRO SCALE 


(Statement Number 4 was not included in the odd statements or the 
even statements when finding the split-half reliability.) 


1. Would most negroes, if not held in their place, become officious, over- 
bearing, and disagreeable? 


YES ? NO 
(2) (3) (4) 


2. If you went into a cafeteria in a northern city, sat down, and then 
realized you were at the table with a negro, would you leave the 


table? 


YES ? NO 
(2) (3) (4) 
3. Would you shake hands with a negro? 
YES ? NO 
(4) (3) (2) 
4. Do you disapprove of the use of the term “nigger’’? 
YES ? NO 
(4) (3) (2) 
5. If you heard of a negro who had bought a home or a farm would you 
be glad? 
YES ? NO 
(4) (3) (2) 


6. In a community in which the negroes outnumber the whites, under 


what circumstances is the lynching of a negro justifiable? 


(a) 
(b) 


(c) 
(d) 
(e) 


Never. (5) 
In very exceptional cases where a specially brutal crime 
against a white person calls for swift punishment. (4) 
As punishment for any brutal crime against a white 
person. (3) 
As punishment for any gross offense (felony or extreme 
insolence) committed against a white person. (2) 
As punishment for any act of insolence against a white 

(1) 


person. 


7. How far in our educational system (aside from trade education) 


should the most intelligent negroes be allowed to go? 


(a) 
(b) 
(c) 
(d) 
(e) 


Grade school, (1) 
Junior high school. (2) 
High school. (3) 
College. (4) 

(5) 


Graduate and professional school. 


8. In a community where the negroes outnumber the whites, a negro 


who is insolent to a white man should be: 


(a) 
(b) 
(c) 
(d) 


(e) 


excused or ignored. (5) 
reprimanded. (4) 
fined and jailed. (3) 
not only fined and jailed, but also given corporal punish- 
ment (whipping, etc.). (2) 
(1) 


lynched. 
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9, All negroes belong in one class and should be treated in about the 


same way. 

Strongl : . Strongly 

eave Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 

10. Negro homes should be segregated from those of white people. 
Strongly , : Strongly 
Approve Approve Undecided Disapprove Disapprove 

(1) (2) (3) (4) (5) 


11. Where there is segregation, the negro section should have the same 


equipment in paving, water, and electric light facilities as are found 
in the white districts. 


Strongly : : Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


12, If the same preparation is required, the negro teacher should receive 
the same salary as the white. 


Strongly Strong] 
Approve Approve Undecided Disapprove Diannrove 
(5) (4) (3) (2) (1) 

13. Practically all American hotels should refuse to admit negroes. 
Strongly Strongl 
Approve Approve Undecided Disapprove iinansiars 

(1) (2) (3) (4) (5) 


14, No negro should be deprived of the franchise except for 
which would also disfranchise a white man. i sii 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (i) 


15. In a community of 1,000 whites and 50 negroes, a drunken negro 

ae Mani rae is trying to arrest him. THE 
MMEDIATELY DRIVE AL 

NEGROES OUT OF TOWN. aS 


Strongly Strongl 
Approve Approve Undecided Disapprove Tiaoreecs 
(1) (2) (3) (4 (5) 


IMPERIALISM SCALE 


1. Should the United States grant complete independence to the Philip- 
pines at an early date? 


YES ? NO 
(4) (3) (2) 
2. Should our forces be withdrawn from Nicaragua? 
YES ? NO 
(4) (3) (2) 


3. The policy of the United States in maintaining the possession of 
the Philippine Islands: 


(a) is exactly what it should be. (1) 
(b) has on the whole more to be said for it than against it. (2) 
(c) has about as many good points as bad ones. (3) 
(d) is difficult to justify. (4) 
(e) is a disgrace to our country. (5) 
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10. 


11. 


12. 


. Economic exploitation of territories and colonies by great powers: 


(a) is totally unjustifiable. (5) 
(b) has some justification, but is on the whole wrong. (4) 
(c) has about as many unjustifiable aspects as justifiable 
ones. (3) 
(d) has some questionable aspects, but on the whole is right. (2) 
(e) is entirely reasonable and right. (1) 
. An American doing business in China should be willing to abide by 
Chinese law. 
Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 


(5) (4) (3) (2) (1) 


. We should use military force in South America whenever needed to 


protect American investments. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 


. In case of severe political and economic upset in China, western na- 


tions should maintain sufficient military forces in China to protect 
all interests previously acquired by their citizens. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) ( (5) 


. We should be willing to let American investments in China be lost 
rather than be drawn into armed conflict with China. 
Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


. Our army and navy should be used when necessary to defend Ameri- 


can property rights in Mexico. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(1) (2) (3) (4) (5) 


An American committing a crime in Shanghai should be tried by a 
Chinese judge. 
Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) ( (1) 


We should co-operate as fully as possible with Latin-American coun- 
tries, treat them as equals, and stop regarding ourselves as their 
leaders and protectors. 


Strongly Strongly 
Approve Approve Undecided Disapprove Disapprove 
(5) (4) (3) (2) (1) 


As a result of inflammatory press dispatches, mobs in a small Latin- 
American country have repeatedly attacked United States flags and 
torn them to shreds. The United States citizens feel that their 
lives are in danger. MARINES ARE SENT TO PROTECT THE 
LIVES AND PROPERTY OF THESE CITIZENS. 


Strongly Strongly 


Approve Approve Undecided Disapprove Disapprove © 


(1) (2) (3) (4) (5) 
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veel @ IV. RESULTS 
right. re 1. The Sigma Method of Scoring 
(1) In order to compare one type of statement with another 
to abide by such as the “multiple choice” with the “strongly approve,” it 
was necessary to devise some technique whereby they might 
sole be made comparable. In attempting to work out such a tech- 
(1) nique, it was noticed that a great number of the five-point 
er needed to statements, i.e. the “multiple choice” or “strongly approve” 
statements (in each case the subject being offered five alterna- 
es tives from which to choose), yielded a distribution resembling 
(5) a normal distribution. 


TABLE I 


PERCENTAGE OF INDIVIDUALS CHECKING THE DIFFERENT ALTERNATIVES, 
CompuTEeD FRoM A SAMPLE OF 100 Cases, ALL MALE, FROM A SINGLE 


, western na- 
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Strongly Scale Number a b c a 4 
i ve 
ine, ie Negro 7 f a 1 3 8 87 
Negro | 8 29 42 26 3 0 
defend Ameri- Imperialism 3 jth 43 27 15 4 
STRONGLY APPROVE STATEMENTS 
i ; 
Disapprove oe 
(5) Strongly Un- Dis- Strongly 


1 be tried by a Approve Approve decided approve Disapprove 


International- 
Strongly ism 6 13 43 21 13 10 
Disapprove Negro 9 3 AY 14 44 22 
(1) Imperialism 5 32 52 10 5 a 
Negro _ 10 24 49 17 at 3 
Imperialism 6 10 27 LY 35 11 


American coun- 
yselves as their 











Table I shows some typical distributions obtained with the 
five-point statements. These percentages are based on a 
sample of 100 cases, all male, from one university. Of the two 
distributions which were quite skewed, number 7 of the Negro 
scale, was the more skewed. The other was number 6 of the 
Negro scale. It is interesting to note that if a group of South- 
ern students are included in these distributions they become 
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less skewed. Thus, for statement number 7 of the Negro 
scale the percentages for 100 male students from a college in 
Virginia are, respectively, 4, 3, 17, 18 and 58. Statements 
number 5 and 6 of the Imperialism scale are illustrative of a 
slight bi-modality which was found in a few of the “strongly 
approve” type of statements. 

On the basis of this experimental evidence and upon the 
results of others (8, pp. 542-548, 28, pp. 71-91), it seems 
justifiable for experimental purposes to assume that attitudes 
are distributed fairly normally and to use this assumption as 
the basis for combining the different statements. The possible 
dangers inherent in this assumption are fully realized. This 
assumption is made simply as part of an experimental ap- 
proach to attitude measurement. It is a step which it is hoped 
subsequent, work in this field will either make unnecessary or 
prove justifiable. Perhaps this assumption is not correct; its 
correctness or incorrectness can best be determined by further 
experiment. 

The percentage of individuals that checked a given position 
on a particular statement was converted into sigma values. 
This was done for each of the five-point statements which in 
our opinion had to do with internationalism. Table 22 of 
Thorndike’s tables (30) greatly facilitated this calculation. 
These tables assume that one hundred per cent of the cases 
fall between —3 and +3 sigma. The values given in the table 
are the average sigma values of intervals represenhted by 
the stated percentages, the origin considered to be at the mean. 
The sigma deviations were always taken from the mean and 
the positive value was assigned to the end which seemed to 
favor internationalism, the negative being assigned to the 
end which favored nationalism. To avoid using negative 
values the arbitrary zero may be placed at —3 sigma rather 
than at the mean. These signs were designated in an arbitrary 
fashion and then verified objectively (see pages 48-52). The 
sigma values were computed from percentages obtained from 
a sample of 100 cases, all male, selected from one particular 
university. Table II shows the percentage of individuals check- 
ing each of the different alternatives and the corresponding 
sigma values for statement number sixteen of the Internation- 


alism scale. 
The statements selected were checked for internal consist- 
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TABLE II 
DaTA FOR STATEMENT NUMBER 16 OF THE INTERNATIONALISM SCAL 
E 
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lem so that the scale values of the statements may be extracted 
from the records of actual voting. If that should be possible, 
then the present procedure of establishing the scale-values by 


sorting will be superseded.” 


Further, it avoids the difficulties encountered when using 
a judging group to construct the scale. A number of 
these difficulties have been pointed out by Rice (27). The fol- 
lowing quotation deals with one of the major shortcomings of 
any technique employing a judging group (27, pp. 190-191) : 


“The difficulties of building scales similar to Thurstone’s 
and of applying them to the measurement of the attitudes of 
social groups, become increasingly difficult once we leave the 
classroom, the discussion club and the other small, compara- 
tively infrequent and highly selected groups that enjoy hav- 
ing experiments tried upon them. Such groups already have 
developed ways of making their attitudes articulate. It is the 
more numerous work-a-day groupings of society, which are 
inaccessible to his controlled measurements, about whose at- 
titudes the social scientist is in the most need of information. 
Students may be required, good natured academicians may be 
cajoled, and sundry needy persons may be paid to sort cards 
containing propositions into eleven piles. But it is difficult to 
imagine securing comparable judgments, or satisfactory meas- 
urements in the final application, from bricklayers, business 
men, Italian-Americans, nuns, stevedores, or seamstresses. 
And, unless the scale itself is based upon equal-seeming dif- 
ferences to a random sample of the group which is to be meas- 
ured, its validity—the degree to which it measures that which 
it purports to measure—becomes open to question.” 


Another decided advantage of the sigma technique is that 
it yields reliabilities as high as those obtained by other tech- 
niques, with fewer items. This is possible because it uses an 
approach to the problem somewhat different from that con- 
ventionally used. Previously attempts have been made to find 
the scale value of each particular statement along a con- 
tinuum; a person’s score being then determined by the scale 
value of the statements that he accepts. In this study, how- 
ever, each statement becomes a scale in itself and a person’s 
reaction to each statement is given a score. These scores are 
then combined by using a median or a mean. Eggan’s study 
reported by Thurstone (35) lends further evidence to support 


the method presented here. 
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In contemplating this method of measuri i a 
- well to realize that the stronger the ban pl ce Jp 
extreme or the other extreme of an attitude continu me 
more it influences the specific reactions. When the = 
set is not strong then the specific items themselves ee 
determine the reaction. In the latter case, however iad 
action is seldom very intense but rather mild! eaRCORE 
That is, the individual’s reactions, so far as ie cot ie ae 
titude is concerned, do not deviate widely from the eo ee 
The sigma technique also yields scores the units ah 
are equal throughout the entire range. Likewise th ye 
kinds of measures can be obtained with it as are obt rol atthe 
other techniques now in existence (38). Thus it agp oT 
to obtain the most typical measure of an individual’ rites 
cee os or dispersion of his attitude pecan 
eedless to say the constructi tn 
sigma method is much easier jae ee . as pol 
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tive end of the sigma scale, and the FIVE end to the positive | 
I end of the sigma scale. (See Table II.) 


After assigning in this manner the numerical values to the _ 
: possible responses, the score for each individual was deter- 
mined by finding the average of the numerical values of the 
positions that he checked. Actually, since the number of state- 
ments was the same for all individuals, the sum of the nu- 
merical scores rather Han ne mean was used. The reliability 
of odds vs. evens for this method yielded essentially the same | 
‘ values as those obtained with the sigma method of scoring. | 
The scores obtained by this method and the sigma method cor- 
related almost perfectly as will be seen in Table IV. 
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The same results were obtained when the values of 1, 8, 4, 5 
and 7 were assigned to the different positions corresponding 
respectively to 1, 2, 3, 4 and 5. In the former case, it will be 
noted that the extremes were given slightly greater weight. 
This method likewise correlated very highly with the sigma 
method and with the 1 to 5 method as shown in Table IV. 

These results seem to justify the use of the simpler methods 
of scoring since they yield almost identical results with the 
sigma method and similarly do not involve any of the errors 
likely to be present in any technique in which experts, judges, 
or raters are used. 

Furthermore, the 1 to 5 method has the additional advan- 
tage over the sigma method for this paricular study in that it 
permits us to combine the reactions on the three-point state- 
ments in the SURVEY OF OPINIONS with those on the five- 
point statements and thus get a more reliable measure of the 
student’s attitude. A three-point statement, it will be recalled, 
is one to be answered bya YES ? NO. 


g4y ii 
Bree ee hee 


ts : 


SFSEETTStT Si strstts chistes teteertr trees pegerreres ys: 






a pen lier 


Hf iit i eRe pie ryt CHHYE 


t 
Waa 


ie positive 


ues to the 
vas_deter- 
ues of the 
r of state- 
reliability 
7 the same 
xf scoring. 
iethod cor- 


7 THE SIGMA 
NEGRO 
Statements) 


o vs. 1-5 


987 
992 


of 1, 3, 4, 5 
responding 
2, it will be 
ter weight. 
the sigma 
ble IV. 
er methods 
°$ with the 
the errors 
rts, judges, 


ynal advan- 
y in that it 
point state- 
on the five- 
sure of the 
be recalled, 





MEASUREMENT OF ATTITUDES 27 


Three methods of scoring the three-point statements were 
tried. The first assigned values of 2, 3 and 4 to the alternative 
responses, the 4 always being assigned to the particular re- 
sponse which seemed to us most “internationalistic.” The 
question mark, of course, always had a value of 3. The second 
method involved the assigning of values of 1, 3 and 5 to the 
particular responses. The third method involved the assign- 
ing of positive and negative signs in the same manner as was 
done with the sigma technique in the case of the five-point 
statements, but here the numerical value assigned was the 
percentage of individuals who checked the opposite position. 
In this manner the responses were weighted in terms of 
typicality and atypicality much as was done in the sigma 
method. For example, if 60% of the individuals checked 
YES, and 25% checked NO (15% checking ?), and if the 
YES is the more international—hence designated positive— 
the score value of the YES is plus 25 and of NO minus 60. In 
this case the question marks were ignored. 

It was found that all three methods yielded essentially the 
same results. Since this was the case, it was decided in this 
study to use the simpler methods throughout.* 

Using the 2-3-4 method for the three-point statements and 
the 1 to 5 method for the five-point statements, a scale was 
eonstructed for measuring attitudes toward internationalism. 
In constructing this scale, not only was the reliability deter- 
mined in essentially the same manner as was done in the sigma 
technique, but the criterion of internal consistency also was 
applied. (See pages 50-52 for a discussion of the criterion 
of internal consistency.) It was discovered that, while there 
was considerable internal consistency between all the state- 
ments used, there appeared to be two groups of statements 
which showed greater internal consistency than inter-group 
consistency. These two groups of statements when examined 
indicated that the one group consisted of statements having 
to do more specifically with imperialism, while the other 
group had to do more with other problems in the field of inter- 
national relations. Consequently, a separate scale was con- 





* It will be noted that the writer began this inquiry with a suspici 

‘ t icio 
attitude toward the simple computations used in Futiie he wlan, and einpied 
these simple procedures only in the light of evidence showing that the 
simpler methods gave the same results as the elaborate. 
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structed for each of these attitudes. In constructing the Im- 
perialism scale the high or FIVE value was always assigned 
to the anti-imperialistic point of view; hence, the higher the 
individual score, the less imperialistic the individual. 

In a similar manner, using all the statements in the SUR- 
VEY OF OPINIONS which had to do with Negroes, a scale 
was constructed for measuring attitudes toward the Negro. 
Table X on page 50 shows the internal consistency obtained 
with the Negro scale. The higher scores are indicative of an at- 
titude favorable to the Negro. Some may question whether the 
numerical values assigned to the different responses of a par- 
ticular statement are valid, asking if the numerical values 
ought not be the reverse in order to conform to “favorable.” 
But it is noteworthy that in every case the assigning of the 
numerical values to the different alternative responses was 
found to be consistent when checked by item analysis or the 
criterion of internal consistency. Among the 87 statements 
used (24 in the Internationalism scale, 15 in the Negro scale, 
12 in the Imperialism scale, and 36 in the Thurstone-Droba 
scales—see pages 33-35) not once was it necessary to reverse 
the numerical values arbitrarily assigned by the experimenter 
to the alternative responses. If the numerical values assigned 
to the alternative responses of a statement, for example, of the 
Negro scale are questioned, then the values assigned to all of 
the statements must be questioned. Judging by the internal 
consistency obtained, the experimenter is either right on all 
the statements or wrong on all of them. To call ‘favorable’ to 
the Negro the opposite alternative of that selected seems to | 
be contrary to ordinary usage. 

The degree of interrelationship between our three scales 
may be briefly indicated for a group of 100 Columbia College 
students (Group D). The raw correlation coefficient between 
the Negro and Internationalism scales is +.40 +.06, corrected 
+.46; that between Negro and Imperialism, raw +.34 +.06, 
corrected, +.40; that between Imperialism and Internation- 
alism, raw, +.63 +.04, corrected, +.70. Material from three 
other universities has yielded very similar results. 


3. The Reliability of the Scales 
The reliability coefficients for the three scales with the 
different groups are given in Table V. A table of the probable 
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; errors of correlation coefficients is given in Table VI. Groups 
A, B and H are from the same university. The other groups 
i are all from different universities. With the exception of 
| Groups A and B only male subjects were used. Only men 
were used in order to make the groups more homogeneous, 

In general, the Internationalism scale seems to have a some- 
what higher reliability than the other two scales. This is not 
surprising in view of its greater length. It is not, however, 
as reliable as might be expected when its length is compared 
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TABLE VI 


PROBABLE ERRORS OF THE COEFFICIENT OF CORRELATION FOR VARIOUS 
NUMBERS OF MEASURES (N) AND FOR VARIOUS VALUES OF r 


spreagtatt 


ShRat 
ret 








Number of ; ’ 
Measures Correlation Coefficient (r) 





(N) 0.65 0.70 0.75 0.80 0.85 0.90 





30 071 063 054 044 034 023 
50 055 049 042 034 027 018 
70 047 041 035 029 022 015 
100 039 035 029 024 019 013 
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with the length of the other scales. The most plausible reason 
for this is that it has a much greater proportion of three-point 
statements than the other scales. The Internationalism scale 
has twelve three-point statements and twelve five-point state- 
ments, the Negro scale has five of the former and ten of the 
latter, and the Imperialism scale has respectively, two and ten. 
On the whole the three-point statements were found to be less 
satisfactory than the five-point statements, but this might well 
be the result of a chance selection of statements in the con- 
struction of the SURVEY OF OPINIONS rather than a func- 
tion of the number of alternatives presented. 

In general it would seem desirable to set .90 as a minimum 
reliability coefficient for a test, due consideration, of course, 
being given to variability. It is regrettable that there were 
not sufficient statements in the SURVEY OF OPINIONS to 
make each scale long enough to yield this reliability. 

In the Negro scale statement number 4 was omitted when 
calculating the split-half reliability. This was done to have 
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an even number of statements in the two halves of the scale so 
as to permit the use of the usual form of the Spearman-Brown 
formula when calculating the reliability coefficients for the 
entire test. . 

It is surprising that the 30-day retest reliabilities are so 
high when it is recognized that this coefficient is the result 
first, of the reliability of the test itself and, second, of the 
changes in the attitudes of the individual subjects during the 
interval. Apparently one is j ustified in concluding that dur- 
ing this 30-day interval the attitudes of the different subjects 
were relatively constant in view of the fairly high reliability 
coefficients that were obtained. In a few cases there were 
marked shifts in a given direction on the part of a particular 
individual. This generally was due to some event which had 
occurred between the first and second tests which caused him 
to change his attitude considerably. For example, one student 
in Group F was in a course in history in which considerable 
information concerning Latin-America was presented. Be- 
tween the first and second tests information was given him 
which he interpreted as justifying imperialism on the part 
of the United States in Latin-America. This resulted in his 
shifting a total of nine points toward a more imperialistic 
point of view. Other similar instances could be presented, 
such as that of the individual who was severely beaten by a 
Negro between the first and second tests. If cases of this kind 
are omitted, the 30-day retest reliability is of course much 
higher. 

In part, at least, the high reliability of the 30-day retest 
may be due to the fact that there is some retention of answers 
on the part of the individuals concerned. When asked, how- 
ever, they invariably reported an inability to recall their 
specific answers on the previous test. The fact that they were 
unable to recall does not mean that the subject would not show 
some retention by the “saving method.” The inability to 
recall one’s answer after a period of thirty days suggests that 
a 30-day retest often may be helpful to determine the honesty 
of the individual answering the first test. This will not de- 
termine every case of insincerity in answering the test because 
in some cases a person might answer, on both the original 
test and on the retest, not in terms of his true attitude but in 


terms of what he thinks his attitude is expected to be. 
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A, The Validity of the Scales 
2 In any discussion of the validity of attitude scales of the 
kind presented here it might be well to emphasize that at pres- 
ent we are dealing only with verbal behavior and claim noth- 
ing more than the importance of the verbal reactions. UlI- 
timately it is to be hoped that the relationship between the 
verbal behavior expressed on an attitude scale and other more 
| overt forms of behavior may be examined and determined, i 
but at present we are concerned with verbal behavior only. 
After all, the verbal reactions studied here are related to prob- 
lems in reference to which the majority of our reactions in 
everyday life are verbal. We declare ourselves in favor of 
one issue and opposed to another, and such declarations are 
socially accepted as symbols for overt acts. In many cases 
it would seem reasonable to conclude that since our daily 
behavior in these areas is largely verbal, the verbal responses 
would be valid indices of other habits. 

Attention, moreover, should be called to the work of Thurs- 
tone (38), Neumann (23), Kulp and Davidson (17), Porter 
(25), and Stouffer (29) in showing the validity of attitude 
scales in measuring attitudes on social questions. It is per- 
haps striking that the individual who (in 1929) was the only 
person to make the highest possible score on the Internation- 
alism scale, who was one of two that made the highest possible 
score on the Negro scale and who made the highest (anti-) 
Imperialism score yet recorded, is a student who has recently 
taken a very prominent part in radical activities on the Colum- 
bia Campus. 
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TABLE VII 


MEANS’ AND STANDARD DEVIATIONS OF THE DIFFERENT GROUPS ON THE 
THREE SCALES 
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Internationalism Imperialism Negro 
Group N M S.D. M S.D. M S.D. 


30 75.52 8.98 35.63 7.34 56.138 6.31 
32 73.09 11.80 34.65 7.10 55.53 6.77 
55 82.40 12.40 40.25 5.95 55.87 5.12 
100 80.24 12.05 37.99 6.98 59.40 6.09 
67.27 9.35 33.41 6.56 54.22 6.23 
33 79.30 9.43 39.03 6.98 60.21 5.27 
100 74.76 12.04 35.15 7.11 56.44 6.23 
92 73.51 10.31 36.67 7.04 54.73 5.86 
123 _—_—-' —_-  ——— 46.35 7.36 
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Table VII shows the means (M) and the standard devia- 
tions (S.D.) of the different groups on the different scales. It 
ig interesting to notice, relative to validity, that on the Negro 
scale the lowest of the northern college groups, Group E, has 
points above that of the college in Virginia. This 
difference (7.87 ) when divided by the sigma of the difference 
(.95) is 8.3 which indicates that it is a reliable difference 

Of course, it cannot be sufficiently emphasized that fia re 
actions on an attitude test are no more meaningful than the 


situation in which the attitude test was given. If the situation 
Fi h as to elici : ‘ 

selves in favor off is suc o elicit the honest cooperation of the subject, so 
h declarations are 


that he will be likely to state his own attitude a 
tata 3 nd not the at- 
titude that he thinks is expected of him or some other orale 


 fictifious attitude, we can feel that we hav i 

aoe : : e a valid measure 
of his attitude. The d i 

1e verbal responsess anger of not having the full cooperation 


of the subject cannot be overemphasized in the present promis 
cuous use of attitude tests. It is significant that the reli 
bilities of the different scales tend to be higher, when all = 
ance is made for variability, in those groups where there - _ 
more reason to expect the cooperation of the student. - 


'5. Comparison of the Simpler Method with the Thurstone 
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TABLE VIII 


COMPARISON OF THE THURSTONE-DROBA WAR SCALE AND THE 
INTERNATIONALISM SCALE 











= Reliability Internationalism 
Coefficients of Scale vs. Thurs- 
Reliability Coefficients International- tone-Droba 
Thurstone-Droba Scale ism Scale Scale 
Form Avs.B Corrected Corrected 
22 Items & B For At- 
Group N V8. 22 44 Items 24 Items Raw tenuation 
C 54 78 .88 88 Bal 81 
.88 .65 75 


F 32 74 85 








In view of the fact that the method presented here when 
compared with the Thurstone method gave evidence of yield- 
ing the same reliability with fewer items, or higher reliabili- 
ties with the same number of items, it was decided to try the 
1 to 5 method of scoring upon the Thurstone-Droba War scale 
to see how it would compare with Thurstone’s method of scor- 
ing. Using Group C each individual was asked to indicate 
whether he strongly agreed, agreed, was undecided, disagreed, 
or strongly disagreed with each statement in the Thurstone- 
Droba War scale, Forms A and B. 

Four statements in each form were not used in the scoring 
because it was found virtually impossible to determine 
whether to assign a value of 1 or 5 to the “strongly agree” 
alternative. An illustration of such a statement is number 5 
in Form A: “Compulsory military training in all countries 
should be reduced but not eliminated.” It is impossible to 
tell whether a person is agreeing or disagreeing with the 
“reduction” aspect of this statement or the “not eliminated” 
aspect. A person who strongly opposes compulsory military 
training would disagree or strongly disagree with the “not 
eliminated” aspect, whereas a person who favors compulsory 
military training would disagree or strongly disagree with 
the “reduction” aspect of the statement. Obviously for the 1 
to 5 method of scoring the statement is double-barreled and of 
little value because it does not differentiate persons in terms 
of their attitudes. Persons at either extreme of the attitude 
continuum can readily check the same alternative. 

Another illustration of a statement that could not be used is 
number 17 of Form B: “Wars often right tremendous 
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wrongs.” This might be treated as a statement concernin 
fact, and could well be agreed with or disagreed with by a —s 
son regardless of his attitude. The other statements that Sao 


not used follow: , 


LE AND THE 


ooo . 
Internationalism q q 
Scale vs. Thurs | 
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one-Droba Form A, statements number 8, 10 and 17 


Scale 
Corrected Form B, statements number 5, 10 and 20. 
For At- } ae ‘ 
Raw  tenuation The criterion of internal consistency, discussed on pages 
a —e - 50-52 was used as an objective check to see (1) whether a 
65 15 numerical values were properly assigned and (2) ial ee 
Yr 


a differentiated the extremes in the manner ex- 
The results expected were obtained and are shown in T 
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= V. PSYCHOLOGICAL INTERPRETATION 


From the foregoing it will be clear that at least three gen- 
eral or group factors in social attitudes have been discovered 
within the student populations which participated in our | 
study. The results require a closer scrutiny of the problem of 
the psychological significance of such group factors, as con- 
trasted with the possibility of their existence as mere sta- 
tistical artifacts. 

From the work of many character testers, notably May and 
Hartshorne, the impression has gotten abroad that behavior is 
almost entirely controlled by the. details of particular situa- 
tions, the intercorrelations between different forms of honesty, 
for example, being exceedingly low. It is shown by the mem- 
bers of the Character Education Inquiry that prediction from 
scores in one situation to scores in another situation is but 
little better than a chance shot. A copious literature has 
already arisen in which the plea is made for indoctrination of 
children in specific moral habits, as contrasted with the teach- 
ing of general moral precepts. That all this discussion is 
really beside the point will be evident in the light of two facts: 
first, that the largest number of tests devised by May and 
Hartshorne for any single character trait was nine, this be- 
ing the number used in measuring “honesty,” while those in- 
volved in measuring “service” and “self-control”? were even 
fewer. The nine tests for honesty were deliberately chosen 
to cover a wide “honesty area.” The average inter-r of the 

entire nine tests was .227. Substituting this figure in the 
Spearman-Brown formula a predicted reliability of .725 was 
obtained (11, II p. 125). It will be noticed that this does not 
really indicate the specificity which is ordinarily assumed tc 
have been proven by the Character Education Inquiry. Fur. 
thermore, the reader will note that May and Hartshorne them. 
selves indulge in predictions as to the number of tests whick 
would have to be devised in order to cover the entire honesty 
area, the entire service area, and the entire self-control area 
The assumption that such an “entire area” exists in a psycho. 
logical and not merely a statistical sense, assumes, of course 
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that a general honesty factor exists. On this basis the only 
significance of the data on specificity is in showing that the 

articular moral habits studied are too few and too distantly 
related to give much prediction from one to the next. Not 
only could other tests have been chosen which would have 
intercorrelated higher, but a longer battery of similar tests 
would have revealed more clearly the magnitude and signifi- 
cance of a general honesty factor. It is in fact obvious that 
the specificity or generality of a trait, as measured, depends 
very largely upon the number and variety of situations used in 
the testing. A trait like honesty is either general or specific 
according to the number and degree of similarity of one’s 
tests. On the other hand, the Character Education Inquiry 
showed lower specificity in honesty attitudes in paper and 
pencil situations than in the overt behavior situations. There 
is, therefore, a reason to suspect that the conversion of be- 
havior dispositions into verbal form tended to make for an 
increase in internal consistency; but this is an hypothesis of 
rather limited value, since of course, all such results will de- 
pend upon the actual attitude tests used. 

What, then, can we mean by affirming that the scaling meth- 
ods here reported indicate high generality rather than speci- 
ficity in social attitude; what is there in the present results 
which is psychologically new? 

The reply requires a consideration of the difference between 
what may be called the biological-science point of view and the 
social-science point of view, in relation to attitudes. From the 
point of view of one trained in the biological sciences, an atti- 
tude is considered to be a disposition of the organism, a dis- 
position depending, of course, upon the constitution and the 
whole life history of the individual. For convenience, one may 
say that an attitude is a conditioned response to certain verbal 
formulae. Attitudes will cluster together insofar as the verbal 
stimuli are similar, or insofar as the individual’s training has 
resulted in the establishment of a final common path for several 
verbal propositions. We should expect, of course, that atti- 
tudes toward the use of the marines in Haiti would differ but 
little from attitudes toward the use of the marines in Nicara- 
gua, because the verbal propositions are parts of almost in- 
distinguishable contexts of verbal situations in which the 
problem of the use of force to protect investment in Latin- 
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America is involved. Even propositions regarding the use of 
force in protecting investments in China will presumably have 
been affected to a large degree by the same influences. 

Furthermore, there exist empirically numerous clusters of 

attitudes in which the stimulus situations do not appear on 
the surface to be similar. Why the attitude toward the Jim 
Crow car and the attitudes toward a Negro’s buying a home or 
farm should be closely linked is not apparent if one considers 
merely the direct social implications of the two. It is only 
when one realizes that both propositions touch off a general 
attitude toward the Negro that one sees the reason for the 
linkage. Quite in contrast with our expectations, we are ob- 
liged to report that there exists a clear-cut pro- or anti-Negro 
sentiment, an emotional and conative disposition which runs 
through the entire fifteen items used to study white attitudes 
toward the Negro. Specific factors there indeed are, as may be 
clearly seen by comparing each item with the next, but even 
with as few as fifteen items, the general factor of a favorable 
(or unfavorable) attitude stands out clearly. This, then, is a 
psychological fact transcending the mere statistical aspects of 
the scaling method involved. 

At this point it will be natural to raise the objection that the 
high generality of such group factors is entirely a result of the 
special social conditions surrounding the education of the par- 
ticular individuals who acted as subjects in our study. This 
point should be not only conceded but emphasized. While 
from the biological-science point of view, it may be sufficient to 
point to the existence of general conative dispositions, it is 
valuable from the social-science point of view to recognize that 
these group factors are aspects of the cultural patterns shared 
by the 650 individuals here tested. In this way, the study of 
the degree of similarity of results from one university to an- 
other offers an empirical method of establishing the degree of 
uniformity of the cultural pattern in which these various 
groups of students participate. As pointed out by Rice (28, 
pp. 125-175), the concept of the cultural area is capable of 
quantitative definition ; and what may be called college student 
attitudes in the northeastern United States toward the Negro 
are shown quantitatively to be amazingly alike in the following 
points: 

In response to the question: “In a community in which the 
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from the study of the reliability of the scales themselves and 
from a study of the range and sigmas of the scores. The 
answer must, of course, be that within each college group very 
large variations are found; for example, though in the north- 
ern college group some very strongly anti-Negro papers and 
in the south some very strongly pro-Negro papers are found, it 
will. nevertheless be seen that sharply contrasting general 
trends do exist. The factors which make for favorableness or 
unfavorableness are legion, but the relative number and 
strength of favorable forces is vastly greater at some colleges 
than at others. 

The degree of interrelationship between our three scales has 
already been indicated. It will be recalled that the uncorrected 
correlation between the Negro and Internationalism scales 
is +.40; that between Negro and Imperialism, +.34; that 
between Imperialism and Internationalism, +.63. Material 
from three other universities yielded very similar results. As 
would be expected, the common ground between anti-imperial- 
ism and internationalism is higher than that which appears in 
other comparisons. The question will naturally arise here 
whether some general characteristic of the student tends to 
make for high scores in all three fields, and thus to produce 
perhaps a spurious correlation between them. The question 
cannot be definitely answered, but in view of the frequent 
argument that general intelligence is responsible for such in- 
tercorrelations as these, it is worth noting that a correlation 
was sought in Group C between internationalism and intelli- 
gence (Otis Self-Administering Higher Examination, Form 
A, 55 cases) and turned out to be —.17; in Group F the cor- 
relation between the same two scores is +.01 (33 cases). In 
view of these slight correlations, the point was not judged 
worth following further in the present study. Cultural causes 
rather than innate differences seem likely to be responsible 
for the interrelations found. 

Having insisted on the social or cultural character of the 
determining forces involved, not only in specific attitudes but 
in general attitude trends, it may be of interest to note that 
some very suggestive evidence exists here as to the presence of 
even more highly generalized attitude factors which at present 
cannot be proven to be cultural. We have already noted the 
correlation of +.40 + .06 between pro-Negro and pro-inter- 
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VI. SUMMARY 


This study has presented a different method of measuring 
attitudes from that ordinarily used. It has attempted to evalu- 
ate this method, both in its longer, more complex form and in 
its simpler form, and to compare it with other methods widely 
used. The results obtained seem to justify the following state- 
ments: 

1. Assuming that attitudes are distributed normally, a 
method of measuring attitudes has been developed which uses 
sigma units. This method not only retains most of the ad- 
vantages present in methods now used, such as yielding scores 
the units of which are equal throughout the entire range, but 
it has additional advantages. These briefly are: first, the 
method does away with the use of raters or judges and the 
errors arising therefrom; second, it is less laborious to con- 
struct an attitude scale by this method; and third, the method 
yields the same reliability with fewer items. 

2. A simpler method was found which yielded essentially 
the same reliability coefficient as the sigma method and cor- 
related so well with this (+.99) that it seems justifiable for 
all ordinary purposes to use the simpler method. The simpler 
technique involved the assigning of consecutive numerical 
values to the different alternatives. (On pages 15-20 the 
numbers in parentheses below the different alternatives show 
the numerical values assigned.) After assigning the numeri- 
cal values to the different possible responses, the score for each 
individual was determined by finding the average-or.sum of 
the numerical values of the alternatives that he checked. 


a 


3. A scale measuring attitudes toward international rela- 
tions constructed by the simpler method when compared with 
the Thurstone-Droba War scale yielded the same reliability co- 
efficients with practically one-half as many items. The coef- 
ficients of correlation between the two scales for two different 
groups was respectively +.71 and -+-.65. When corrected for 
attenuation these coefficients became +.81 and +.75. This 
relationship is obtained in spite of the fact that the statements 
in the two scales are quite dissimilar. 
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APPENDIX 
\ 
THE METHOD OF CONSTRUCTING AN ATTITUDE SCALE 


I. The Selection of Statements 

Each statement should be of such a nature that persons with 
different points of view, so far as the particular attitude is 
concerned, will respond to it differentially. Any statement to 
which persons with markedly different attitudes can respond 
in the same way is, of course, unsatisfactory. 

The results obtained in constructing the present scales dem- 
onstrate the value of the following criteria. These criteria 
were kept in mind in collecting the statements for the original 
Survey of Opinions. 

1. It is essential that all statements be expressions of de- 
sired behavior and not statements of fact. Two persons with 
decidedly different attitudes may, nevertheless, agree on ques- 
tions of fact. Consequently, their reaction to a statement of 
fact is no indication of their attitudes. For example, a person 
strongly pro-Japanese and a person strongly pro-Chinese 
might both agree with the following statements: 


“The League of Nations has failed in preventing Japan’s 
military occupation of Manchuria.” 
i or 
“Japan has been trying to create in Manchuria a monopoly 
of trade, equivalent to closing the ‘open-door’ to the trade of 
other countries.” 


To agree with them or believe them true is in no way a meas- 
ure of attitude. 

Rice (27, p. 184) has clearly stated the importance of rec- 
ognizing this criterion when in discussing the Thurstone 
technique he says: 


“What is the possibility that the acceptance or rejection by 
a subject of a statement upon the completed scale may repre- 
sent a rational judgment concerning the truth or falsity of the 
statement made? It would seem to exist. If so, the validity 
of the statement as an index of attitude is destroyed or im- 
paired.” 
44 





45 


In dealing with expressions of desired behavior rather than 
expressions of fact the statement measures the present atti- 
tude of the subject and not some past attitude. The impor- 
tance of dealing with present rather than bast attitudes has 
been emphasized by Thurstone (38) and Murphy (22, p. 615), 












sh A very convenient way of stating 4 proposition so that it does _, 
is involve desired behavior is by using the term should. The \ 
to | use of should is well illustrated in the “strongly approve” 
nd type of statements shown on pages 15-20, 
2. The second criterion is the necessity of stating each prop- 
‘m- osition in clear, concise, straight-forward statements Each 
ria statement should be in the simplest possible vocabulary, No 
nal statement should involve double negatives or other wording 
which will make it involved and confusing Double-barreled 
de- statements are most confusing and Should always be broken in 
with two. Often an individual wishes to react favorably to one 
jues- part and unfavorably to the other and when the parts are to- 
it of gether he is at a loss to know how to react. Thus in the fol- 
syson lowing illustration a person might wel] approve one part and 
inese disapprove another part: 
“In order to preserve peace, the United States should abol- 
ns ish tariffs, enter the League of N ations, and maintain the larg- 
a est army and navy in the world.” 

To ask for a Single response to this statement makes it mean- 
mopoly ingless to the subject. This statement should be divided into 
cade of at least three separate statements, 

The simplicity of the vocabulary will, of course, vary with 
a, meas- the group upon whom the scale is intended to be used, but it is 

a desirable Precaution to state each Proposition in such 4 Way 
s of rec- that persons of less understanding than any member of the 
wevstone 8roup for which the test is being constructed will] understand 
and be able to respond to the statements. Above all, regard. 

less of the simplicity or complexity of vocabulary or the na- 
sction bye iveté or sophistication of the group, each statement must avoid 
Ly repre- every kind of ambiguity. 
iy ee | 3. In general it would seem desirable to have each state- ; 
; ae im ment so worded that the modal reaction to it is approximately \ 
: in the middle of the Possible responses. 
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\ 4, To avoid any space error or any tendency to a stereo- 
typed response it seems desirable to have the different state- 
ments so worded that about one-half of them have one end of 
the attitude continuum corresponding to the left or upper 
part of the reaction alternatives and the other half have the 
same end of the attitude continuum corresponding to the right 
or lower part of the reaction alternatives. For example, about 
one-half the statements in the Internationalism scale have the 
international extreme corresponding with “Strongly approve” 
while the other half has it corresponding with “Strongly dis- 
approve.” These two kinds of statements ought to be dis- 
tributed throughout the attitude test in a chance or haphazard 
manner. 
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5. If multiple choice statements are used, the different alter- 
natives should involve only a single attitude variable and not 


several. 


II. Constructing the Scale 

It is usually desirable to prepare and select more statements 
than are likely to be finally used, because after trying the 
statements upon a group, some may be found to be quite un- 
satisfactory for the intended purpose. For this reason after 
selecting a good number of statements they should be given to 
the group or a part of the group whose attitudes we wish to 
measure. The sample used should be sufficiently large for 
statistical purposes. 

For purposes of tabulation and scoring, a numerical value 
must be assigned to each of the possible alternatives. If five | 
alternatives have been used, it is necessary to assign values of 
from one to five with the three assigned to the undecided posi- 
tion on each statement. The ONE end is assigned to one ex- 
treme of the attitude continuum and the FIVE to the other; 
this should be done consistently for each of the statements 
which it is expected will be included in the scale. Thus if we 
arbitrarily consider the “favorable to the Negro” extreme 
FIVE and the “unfavorable to the Negro” extreme ONE, the 
alternative responses to the following statements would be 


assigned the values shown: 
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“How far in our educational system (aside from trade 


presterion! education) should the most intelligent negroes be al- 
: lowed to go? 
1 (a) Grade school. 
2 (b) Junior high school. 
3 (c) High school. 
4 (d) College. ; 
5 (e) Graduate and professional schools.” 
“In a community where the negroes outnumber the whites, 
a negro who is insolent to a white man should be: 
5 (a) excused or ignored. 
4 (b) reprimanded, 
3 (c) fined and jailed. 
5) (d) not only fined and jailed, but also given corporal 
< punishment (whipping, etc.). 
1 (e) lynched.” 
“AJl negroes belong in one class and should be treated in 
. about the same way.” 
STRONGLY STRONGLY 
APPROVE APPROVE UNDECIDED DISAPPROVE DISAPPROVE .- 
Value (1) (2) (3) (4) (5 
“Where there is segregation, the negro section should have 
the same equipment in paving, water, and electric light 
facilities as are found in the white districts.” 
STRONGLY STRONGLY 
APPROVE APPROVE UNDECIDED DISAPPROVE DISAPPROVE 
Value (5) (4) (3) (2) (1) 


Some may object to the designation made, saying that the 
terms “favorable” and “unfavorable” are ambiguous or that 
the favorable attitude is just opposite to that here considered 
favorable. Thus, if one wishes to call favorable to the Negro 
the following responses to the statements shown on pages 
18-19, no serious objections will be raised providing that he is 
consistent in his designations; to do so, however, does seem to 
be less reasonable and not in accord with common usage. 








Statement Number Response 
Yes 


CoOnNawironre 
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Strongly approve 
10 Strongly approve 
il Strongly disapprove 
12 Strongly disapprove 
13 Strongly approve 
14 Strongly disapprove 
15 Strongly approve 
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So far as the measurement of the attitude is concerned, it is 
quite immaterial what the extremes of the attitude continuum 
are called; the important fact is that persons do differ quanti- 
tatively in their attitudes, some being more toward one ex- 
treme, some more toward the other. Thus, as Thurstone has 
pointed out in the use of his scales, it makes no difference 
whether the zero extreme is assigned to “appreciation of” the 
church or “depreciation of” the church, the attitude can be 
measured in either case and the person’s reaction to the church 


expressed. 


a The split-half reliability should be found by correlating the © 


he 


sum of the odd statements for each individual against the sum 
of the even statements. Since each statement is answered by ° 
each individual, calculations can be reduced by using the sum © 
rather than the average. | 

An objective check ought then to be applied to see (1) if the 
numerical values are properly assigned and (2) whether the 
statements are “differentiating.” One possible check is item 
analysis which calls for calculating the correlation coefficient 
of each statement with the battery, -If a negative correla- 
tion coefficient is obtained, it indicates that the numerical 
values are not properly assigned and that the ONE and FIVE 
ends should be reversed. us a zero or very low )jcorrelation 
coefficient is obtained, it indicates that the statement fails to 
measure that which the rest of the statements measure. Such 
statements will be called undiferentiating Thurstone (38) 
refers to them as irrelevant or ambiguous. By “undifferentiat- 
ing” we merely mean that the statement does not measure 
what the battery measures and hence to include it contributes 
nothing to the scale. A statement which is undifferentiating 
for a scale measuring one attitude continuum may be quite sat- 
isfactory for a scale measuring another attitude continuum. 
The following are some of the reasons why a statement may 
prove undifferentiating: 


1. The statement may involve a different issue from the one 
involved in the rest of the statements, that is, it involves a 
different attitude continuum. 


2. The statement may be responded to in the same way by 
practically the entire group. For example, the response to 
the following statement was practically the same upon the part 
of all students—some two thousand—to whom it was given: 
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: United Stat a : 
fee ee os ates repeal the Japanese Exclusion 
5 -The statement may be so expressed that it i 3. 
stood by members of the group. This may ce Ma 3H Taine 
poorly stated, phrased in unfamiliar words or word re eing 
form of a double-barreled statement. . ed in the 
4. It may be a statement concerning fac a 
who fall at different points on the ols ete atte 
equally liable to accept or reject. um will be 


It is, of course, desirable in constructing an attitude scal 
that the experimenter exercise every precaution in the ee 
ing of statements so as to avoid those that are undifferentiat- 


ing... However, item analysis can be used as an objective check 


to determine whether the member ‘ : 
entially to the statement in the athe keene neh ed 
differentially to the battery; that is, item analysi ley react 
whether those persons who fall toward one end a th —— 
continuum on the battery do so on the particular stat e attitude 
vice versa. Thus item analysis reveals the oe tar and 
any statement so far as its inclusion in a gi CORTES of 
is concerned. given attitude scale 
No matter for what a priori r 3 
cons der ci Lcandch es i sapepe iC may 
aaa sk group, does not measure what the cots ot a 
Pee rent in t ae there is no justification for keeping that 
Grind the attit e battery. After all, we are interested in 
udes of the members of the gr ape 
the experimenter. group, not those of 
There i 
oer eS ie vem to expect that the logical analysis of the 
Oa by the cts the statements will necessarily be su 
tad yt soup, Gut fen eae of «Ine of une 
menter may find that the statements a “ group, the experi- 
: s ot for 
hrc hat he expe a important peo 
ee ean what these clusters are as it is to be able t = 
? o meas- 
The degree of inclusion, i.e. the gi 
effici usion, 1.e. the gize of the correlati 
Cheat ere item and the battery, required ee “i 
ES ope alpen omer function of the purpose for 
ae , itudes are being measured. If a general sur r 
study is being undertaken the degree of Seated fe 
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quired will be less than when a more specialized aspect of at- 
titudes is being studied. A similar relationship is to be noted 
in the measurement of intelligence. 


The only difficulty in using item analysis is that the calcula- E 


tion of the necessary coefficients of correlation is quite labori- 


ous. The criterion of jnternal consistency was tried and the a 


id 
results obtained were found to be comparable with the results 


from item analysis. Table X shows a comparison of the re. ~ 


sults obtained from item analysis and the criterion of internal 
consistency. It will be noted that the relation between the 
order of excellence for the different statements as determined 
by item analysis and the criterion of internal consistency as 


expressed by rho is +.91. Since the criterion of internal con. — 
sistency is much easier to use than item analysis and yet yields — 


essentially the same results, its use is suggested. 


TABLE X 


CoMPARISON OF THE RESULTS OBTAINED FROM THE APPLICATION OF THE — 
CRITERION OF INTERNAL CONSISTENCY AND ITEM ANALYSIS TO THE NEGRO ~ 


ScALE For Groups “A” AND “B” COMBINED—(N = 62) 
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Column 1 Column 2 Column 3 Column 4 Column 5  & | 
1 .69 1.7 2 
2 .64 1.5 6 
3 51 Li 10 
4 18 0.4 14 
5 62 1.3 7 
6 .40 0.7 11 
7 12 0.1 15 
8 39 1.1 12 
9 .26 0.9 13 

10 .65 2.7 5 
11 .60 1.2 8 
12 54 1.4 9 
13 67 2.3 4 
14 74 2.0 1 
15 .68 1.6 3 





rho (Column 4 vs. Column 5) = +.91 
Column 1—Statement numbers. 


Column 2—Coefficient of correlation between the score on the individual — 


statement and the average score on all fifteen statements. 


Column 3—Difference between the average score of the highest 9 individ: § 


uals and the lowest 9 individuals. 


Column 4—Order of excellence as determined by item analysis based ¥ 


upon the coefficients of correlation shown in Column 2. 


Column 5—Order of excellence as determined by the criterion of ine | 
ternal consistency based upon the differences shown in — 


Column 3. 


a In using the criterion of internal consistency the reactions 3 | 
of the group that constitute one extreme in the particular atti- — 
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eing measured are compared with the reactions of the 
that constitute the other extreme. In practice ap- 
group ately ten per cent from each extreme was used. Table 
Shaws the criterion of internal consistency applied to the 
Internationalism scale for Group D. This criterion acts as an 
piective check upon the correct assigning of numerical values 
: Mak if the numerical values are reversed on a particular 
BE ent the extreme high group will score low on that state- 
ment and the extreme low group will score high, i.e. we will 
obtain a negative difference between the two extreme groups 
on that question. Furthermore, if a statement is undiffer- 
entiating it will not differentiate or discriminate the two ex- 
treme groups, i.e. the high group will not score appreciably 
higher than the low group upon that statement. 
_ Finally, on the basis of the results obtained from item anal- 
ysis or the criterion of internal consistency and having due 
regard for all the factors concerned, one should select the most 
differentiating statements for the final form or forms of the 
attitude test. If, through this selection of the more differ- 
entiating statements, statements concerning a particular as- 
pect of the attitude being measured are eliminated, then, ob- 
viously, the final scale can only be said to measure the attitude 
continuum represented by the remaining statements. For ex- 
ample, if it is found by the use of these objective checks that 
statements concerning the economic status of the Negro in- 
volve an attitude continuum other than that of statements 
having to do with the social equality of the Negro, the former 
should not be mixed with the latter. On the contrary, two 
attitude scales should be constructed. If, on the other hand, 
these two groups of statements are found to involve the same 
attitude continuum, they can be combined into a single scale. 
As previously stated, the degree of inclusion required or de- 
sired will generally be a function of the purpose for which the 
attitude scales are being used. 

A sufficient number of statements should be used in each 
form to obtain the desired reliability. In preparing the final 
form or forms, it would be desirable to apply the fourth crite- 
rion stated under “The Selection of Statements.” 

Because a series of statements form a unit or cluster when 
used with one group of subjects which justifies combining the 
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reactions to the different statements into a single score, it does 
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not follow that they will constitute a unit on all other groups 
of persons with the same or different cultural backgrounds, 
For example, an examination of the statements in the Impe. ~ 
rialism scale will reveal that it contains statements having to do a 
with imperialism both in China and Latin America, and while F 
it is true that these statements form a sufficient cluster to | 
justify their being treated as a unit with the groups used, stil] y 
with other groups of persons with markedly different attitudes | 
toward China or Latin America it is probable that this single a 
scale would have to be divided into two or more scales. yy 
The ease and simplicity with which attitude scales can be | 
checked for split-half reliability and internal consistency | 
would seem to make it desirable to determine the reliability ‘s 
and examine the internal consistency of each attitude scale for 
each group upon which it is used. It is certainly reasonable § 
to suppose that just as an intelligence test which has been 2 
standardized upon one cultural group is not applicable to an- | 
other so an attitude scale which has been constructed far one 
cultural group will hardly be applicable in its existing form to 4a 
other cultural groups. | 
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TABLE XI 
CRITERION OF INTERNAL CONSISTENCY APPLIED TO THE INTERNATIONALISM SCALE FOR Group “D’—(N = 100) 
HIGH GROUP STATEMENT NUMBERS 
Three-Point Statements Five-Point Statements 

Indiv. 

No. Scove 1 2 3 4 5 6 7 8 9 I di dz 18 14 15 16 17 Y8 19 20 21 22 88 Bh 
85 108 A444 4 44 44 4 4 4 5 & 5 5&6 56 & & 5B & 6&6 b&b Bb 
65 104 4 4 8 4 4 4 4 4 4 4 4 4 bs & FF FE S&S & SF S&S B&B & A 
13 102 4 4 4 4 4 4 4 4 4 4 4 4 5 5 8 56 5 &6 6 56 5 8 8 5 
10 = 101 Aa4ida4a4 4 4 4 4 4 42 43 8 4 58 & 5&6 & 5&5 4 8 6 
71 101 29 @ 4 @*« 4&4 &2 BB 4 A 4 42 5 8 4 5 & 5&6 & & & & 8B 5B 
98 100 4 4 4 4 4-4 4 4 4 4 4 A 5 8 «6 6 64~«“éS(a<‘<i‘i “CCU KlhlC SB lUC CGlClUCS 
27 98 4 2 4 4 4 4 4 4 4 4 4 4 46 8 & & 56 424 4 8&8 2 ob 6&8 
60 98 444A 4 4 4&4 2 2&2 BB 424 4 @ 5 6&6 8 4 & 5&5 2 6 b 4&2 BS 6 
64 98 4&4 #& 4 4 @& & &@ 2 2 4 @ 4 $8 4 8 & S &B S&S & &€ & 4 

Sum of 9-high34 34 35 36 36 36 32 36 32 36 36 36 42 37 85 40 45 45 40 44 45 385 41 42 

nanan nee ee aan n nn EnD IEEE EEUU 

Sum of 9-low 18 20 20 28 24 29 21 20 22 21 34 28 21. B24 22 15 B81 22 15 22 24 17 14. 22 

D 16 14 15 8 12 7 11 16 10 15 2 13 21. 18 18 25 14 28 25 22 21 18 27 20 

a Ng a a a A re we be Se ee EE a we ee ae ee 

D/9 18 1617 38 13 §$ 12 18 Ll LT 22 1lé4 23 1.41428 16 2.6 28 24 2.3 2.0 3.0 2.2 
a 
Order 15 53835 10° 7 1 8 15 9 3h 12 6 6.511.511.5 25 10 425 565 9 1 8 

(3-point statements and 5-point statements treated separately) 

LOW GROUP 
aly 49 B29 & 2 2 2 4 #4£€ F&F 2B BB ct £ ff £ @ #2 A BS #2 2 Tt B 
77 54 QB 2 @ 2 2 4 2 2 ZB & A B 2 S$ S$ «= 42A 2 ££ 2 2B b&b 2B 
22 60 o FB FF @2@P £2 4 &@ 2 2B 2 4&4 ZB A $8 It 8A 2 2 2S 4&4 2 1 B 
35 61 2 2 43 8 2 2 &4 4 4A 8B 2 2 838 fés8?2e?3sthsé 2 2 2 
53 62 o fF 2 4 4 2 2 BSB 2B 2 424 B f @ 2 2 2B BS &2& 8S 2b WL &* 2b 
69 62 > 2 4&4 2 2 4&eseee 2B «#t 8B S 8 $ 2 # £aoa & 2 ££ a@ 
94 63 2 O9 fF 4 38 4&2 2 2 € 2B @A 4 2 @ 8&8 2 €¢€ 2B Ff B 2 ® 2 B 
21 64 ao 2 2 2 @ 4A 8B 2 BB 2A SG 2 8 8 YJ 4&4 & @ B BF 2 B a 
88 64 2 #£ 2 a2 2 BB 2 2B 2B 2B aA A 4 8 8 1244 2 2 1 2 & 38 











Sum of 9-low 18 20 20 28 24 29 21 20 22 21 34 23 21 24 22 15 31 22 15 22 24 17 14 22 
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